Markov Decision Processes Publications

Publications in Markov Decision Processes

Explore the most influential research papers and scholarly works that have shaped Markov Decision Processes. Use the concept filter below to focus on a specific sub-area of research.

Markov Decision Processes

994

Publications

113.6K

Citations

Showing yearly statistics from 2000-2026.

Page 1

	Year	Citations
Reinforcement Learning: An Introduction IEEE Transactions on Neural Networks Artificial IntelligenceEngineeringDeep Reinforcement LearningStochastic GameGame Theory	2005	25.7K
Markov Decision Processes: Discrete Stochastic Dynamic Programming. Kasra Hazeghi, Martin L. Puterman Journal of the American Statistical Association Markov Decision ProcessEngineeringStochastic GameUncertainty QuantificationStochastic Processes	1995	8.4K
Markov Processes: Characterization and Convergence. Andris Abakuks, S. N. Ethier, Thomas G. Kurtz Biometrics EngineeringMarkov Decision ProcessesStochastic AnalysisStochastic PhenomenonStochastic Differential Equations	1987	4.5K
Dynamic Programming and Markov Processes. Marshall Freimer, Ronald A. Howard Journal of the American Statistical Association EngineeringStochastic ProcessesDynamic ProgrammingDynamic ProcessMarkov Decision Processes	1961	3.4K
Markov Models in Medical Decision Making Frank A. Sonnenberg, J. Robert Beck Medical Decision Making EngineeringPrognosisMarkov Decision ProcessesDiscrete-event SimulationHospital Medicine	1993	2.4K
A Markovian Decision Process Richard Bellman Indiana University Mathematics Journal EngineeringEquipment Replacement ProblemIndustrial EngineeringIndustrial Replacement ProcessMarkov Processes	1957	2.4K
Markov Decision Processes: Discrete Stochastic Dynamic Programming Laurence A. Baxter, Martin L. Puterman Technometrics EngineeringDynamic ProgrammingMarkov Decision ProcessesProbability TheoryMarkov Decision	1995	1.9K
Finite Markov Chains. Keith Bush, John G. Kemeny, J. Laurie Snell American Mathematical Monthly Markov ChainsEngineeringNatural SciencesHidden Markov ModelStochastic Processes	1960	1.6K
Markov Chain Monte Carlo in Practice. Robert E. Kass, W. R. Gilks, S. Richardson, Journal of the American Statistical Association Markov ChainsEngineeringMonte Carlo MethodsMarkov Decision ProcessesProbability Theory	1997	1.4K
The Complexity of Markov Decision Processes Christos H. Papadimitriou, John N. Tsitsiklis Mathematics of Operations Research Mathematical ProgrammingEngineeringGame TheoryComputational ComplexityMarkov Decision Processes	1987	1.3K
An Introduction to Stochastic Modeling Michael Frey, Howard M. Taylor, Samuel Karlin Technometrics EngineeringDiscrete ProbabilityMarkov Decision ProcessesStochastic AnalysisStochastic Phenomenon	1994	1.3K
Markov Chains with Stationary Transition Probabilities. Peter Whittle, Kai Lai Chung Journal of the Royal Statistical Society Series A (General) Markov ChainsEngineeringNatural SciencesHidden Markov ModelStochastic Processes	1962	1.2K

Page 1